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The method comprises the steps of: - illuminating a portion 
of space situated in the region through which the vehicle is 
about to travel (1) by means of a plurality of pulses (5, 6) 
emitted at predetermined time intervals; - monitoring the 
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scene in front of the vehicle (1), including the light which is 
,/ reflected back by the obstacle (3) in respective time 

windows; - reconstructing the image graphically, and - 
displaying the reconstructed and processed image on the 
windscreen. 

EXEMPLARY CLAIMS- 1. A method for detecting images of 
an object (3) in conditions of poor visibility, characterised in 
that it comprises the steps of: - sending (4) a train of light 
pulses (5, 6) towards the object (3); - observing (2) the 
object (3) illuminated by the pulses (5, 6) in respective time 
windows (10); - reconstructing (12 to 14) images of the 
object (3) from the observations in the respective time 
windows (5, 6) and - displaying (15) the images thus 
reconstructed.; 2. A method according to Claim 1, 
characterised in that the pulses (5, 6) are monochromatic 
light pulses (4), preferably with a wavelength (lambda) 
substantially equal to 900 nm.; 3. A method according to 
Claim 1 or Claim 2, characterised in that the object (3) is 
observed in substantially monochromatic conditions.; 4. A 
method according to Claim 2 and Claim 3, characterised in 
that the object (3) is observed by means of filtering at a 
wavelength which corresponds substantially to the 
wavelength of the monochromatic light (14) of the pulses (5, 
6).; 5. A method according to any one of Claims 1 to 4 
characterised in that the duration of each observation time 
window is of the same order of magnitude as the duration of 
each light pulse (5, 6).; 6. A method according to any one of 
Claims 1 to 4, characterised in that each observation time 
window has a duration equal to a plurality (Nq) of light 
pulses (5, 6).; 7. A method according to Claim 1 or Claim 6, 
characterised in that each observation time window has a 
duration T with T =; 2D; c; where c is the speed of light in 
the observation medium and D is the maximum permitted 
distance of the object. 
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The title of the invention has been amended (Guidelines for Examination In the EPO, A-lll. 7.3). 
@ Method and device for testament-assisted vision In poor visibility, particularly for driving bi fog. 

@ The method comprises the steps of: 
-fflumtnaflng a portion of space situated In the region through 
whfch the vehicle Is about to travel (1) by means of a plurality of 
pulses (5, 6] emitted at predetermined lime intervals; 
* monitoring the scene In front of the vehicle (1). including the 
Bght which is reflected back by the obstacle (3) In respective 
time windows; 

- reconstructing the Image graphically, and 

- displaying the reconstructed and processed Image on the 
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Description 

A method and device (or instrumental vision hi conditions of poor visibility, particularly for driving In fog 

The present Invention relates In general to the display of scenes In conditions of low visibility. 
In particular, the present invention has been developed with a view to its possible use for facilitating the 
5 driving of motor vehicles In conditions of poor visibility, tor example in fog. 

Devices which use equipment with radar systems have already been proposed for Identifying objects In fog. 
Whilst they enable objects to be located In conditions of poor visibility, these devloes are not without 
disadvantages for use In motor vehicles since the Instrumental Information they supply Is not readily 
understood by the average driver. 
10 In general, the problem with vision in fog, both during the day and at night, results from the low level of 
illumination of the detector by the object to be detected compared with the level generated by the scattering of 
the ambient fight by the fog itself. 

In fact, the scattering by the fog obviously affects ail of the Illuminated space and the signal detected by the 
receiver is dependent on the space itself and on the laws by which the light is attenuated/propagated in the 
IS receiving geometry In question. 

The presence of an object to be detected in order to describe the scene, however, is connected only with 
reflection/scattering by the surface of the object which faces the receiver. 

As a result, the signal/noise ratio Is largely dependent on the density of the scattering medium In the space 
between the observer and the object 
20 Moreover, regardless of the method used for detecting the Image of the scene, there are two basic 
aproaches to the problem of using the information obtained: 

a) the reproduction of a processed scene which stfll contains the shape and appearance of what the 
observer would see If the visibility were better (Interpretation and decision on the part of the observer); 

b) the reproduction of summarised Information concerning the contents of the scene without the 
26 "photographic* reconstruction thereof (interpretation -and decision -on the part of the automatic 

system). 

Case a) Includes television systems for detection In the visible and near-Infrared; case b) Includes 
microwave rafter systems and passive thermographic systems, whilst far-Infrared (10 micron) systems with 
active illumination belong to an intermediate category. 
30 Essentially, the object of the present Invention Is to provide means for seeing In conditions of poor visibility, 
which are suitable for application In the automotive field, particularly with regard to driving In fog, end at the 
same time ensure reliable monitoring, even In critical conditions, end the ability to reconstitute for the driver 
visual information which Is immediately reconglsable as an Image of the scene at which he Is looking. 
According to the Invention, this object Is achieved by virtue of a method for detecting Images of an object In 
35 conditions of poor visibility, characterised in that it comprises the steps of: 

- sending a train of Dght pulses towards the object, 

- observing the object Illuminated by the pulses in respective time windows, 

- reconstructing Images of the object from the observation in the respect time windows, and 

- displaying the Image thus reconstructed 

40 A further object of the present Invention is a device for detecting images of an object in conditions of poor 
visibility, particularly by the method specified above, characterised in that It comprises: 

- illumination means for sending a train of light pulses towards the object, 

- televisual means for observing the object Illuminated by the pulses and tor generating corresponding 
television signals, the televisual means including a shutter which Is operable selectively to make the televisual 

46 means sensitive only In respective time windows, 

- processor means for reconstructing Images of the object from the television signals obtained, and 

- display means for presenting the reconstructed Images. 

For a better understanding of the Invention, a description of an embodiment of the Invention will now be 
given, purely by way of non-limiting example, with reference to the appended drawings, in which: 
60 - Figure 1 shows schematically a possible situation of use of an Instrumental vision device according to 

the invention, and 

- Figure 2 shows the structure of part of the device of Figure 1 Jn greater detail, In the form of a block 
diagram. 

With reference to Figure 1, acar, Indicated 1, Is provided with a device 2, 4 for detecting, In accordance with 
35 the invention, the preence of a moving car 3 which Is not visible to the driver of the vehicle because of fog 
between the two vehicles 1 and 3. A lamp. Indicated 4, preferably with monochromatic emission (for example, 
operating at a wavelength X of the order of 900 run) , Is mounted on the front part of the car 1 and can emit light 
pulses of a duration x (e.g. 10* seconds) with a frequency of repetition f =1/T equal to an average of 3 KHz, 
where T represents the Interval between the pulses. 
60 Each pulse emitted by the tamp 4 Is propagated In the space In front of the car 1 and illuminates a respective 
•window" or "slice" with a depth C t (where C Is the speed of light In the medium) equal, for example, to 
approximate^ metres (not to scale In the drawings) . This window moves forwards towards the car 3 as shown 
schematically in Figure 1 where 5 and 6 represent the successive positions reached by the window 
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corresponding to a given light pulse or, alternatively, the positions reacted at the same time by two pulses 
emitted In succession. 

In the case of the window 5. which Illuminates a space without obstacles, It Is clear that no image will be 
returned to the vehicle 1. except that due to the backscatterlng caused by the fog. 

In the case of the window 6, however, both the fog and the obstacle (the vehicle 3) wOl contribute to the 6 
signal since, In this case, the useful back-scattering region 7, that is, the rear part of the car 3 is includedln the 
space illuminated by the pulse. 

The reference numeral 2 Indicates a processing system which is also mounted on the front part of the car 1 
and is constituted by a tens 8 adapted to focus the reflected image of the obstacle 3* (whose Intensity is very 
low) onto an Image intenslfler 1 0. In this way. a completely reconstructed Image of the vehicle 3 is provided by to 
the subsequent processing of the intensified signal by a televisual sensor 11 (for example, of the CCD type}, by 
the respective management unit (television camera) 12, and by a processing and control system 13 and 14. 

The image reconstructed by the processing and control system 13, 14 (which also controls the operation of 
the lamp 4) can then be presented on the windscreen by means of a head-up display unit 15, according to 
criteria widely known In the aeronautical field. The driver can thus see the obstacle 3 with the exact dimensions 15 
and at the exact dstance at which It Is situated, under Just the same conditions as those governing vision 
under conditions of normal visibility. 

The image intenslfler 10 used In the device according to the invention is adapted for pulsed operation and 
thus also for performing the task of a shutter (as will be specified below) so as belter to discriminate between 
the backscatterlng from the obstacle to be displayed and that from the fog. 20 

According to a variant of the Invention, the rapid obturation of the television camera t1, tacaniedront by the 
Intenslfler device 10 may alternatively be achieved by control of the grid voltage of any vacuum tube (e.g. a 
vtdicon) which replaces the CCD televisual sensor 11, or at any rate other sensors for carrying out these 
functions. 

In order better to understand the criteria governing the pulsed operation of the Intenslfler shutter 10 (or a 25 
member equivalent thereto) which Is controlled by the system 14 through a piloting fine 16, it should be noted 
that any object lying In a space illuminated by the pulses from the lamp 4 reflects back/scatters the incident 
light. The sources of the light "echo" are located in the space and are active continuously or In pulses at the 
moment when the Illuminating wave front 5, 8 strikes them. 

if a scattering medium (fog) Is present, in addition to the attenuation of ail the light signals passing through so 
it, there Is also an emission (continuous or pulsed) of backscattered radiation constituting a background 
which can rapidly mask the other signal sources. 

However, if only pulsed Illumination is considered, there Is, at any moment, a layer (whose shape depends 
on the Dtumlnating lens) with a thickness c t (c » the speed of light, t - pulse duration). If a receiving time 
window of a duration t is opened (by means of the actuator 10) with a delay n x (n= 1 , 2, 3...) relative to the 35 
Illuminating pulse, an image of a 'slice" of the space of a thickness c t at a distance 



n ~K. c 
2 



40 



Is obtained. 

If mere is an object In this slice, the ratio between the signal reflected back/scattered by the object and that 
scattered back by the fog in the space is at a maximum, 4? 

This signal is propagated towards the receiver 2 and Is attenuated due to the characteristics of the 
propagation medium, but the original signal/background ratio remains unaltered. 

This is because the receiving time selected by the shutter 10 excludes all the signal contributions outside 
the selected "slleeV 

Since the positions of various objects in the scene are not known beforehand, it is necessary to carry out a 60 
scanning sweep through the entire space up to the greatest distance of Interest in order to achieve complete 



Quantitatively, and as a first approximation, the Improvement In the signal/background (S/N) ratio resulting 
from the use of a pulsed muminatlon-detectlon system can be evaluated by considering that: 

1) with continuous Illumination, this ratio (S/N) Is proportional to Ro/Rv where Ro is the signal reflected 
back/scattered by the object to be displayed (vehicle 3) and Rv Is the signal scattered back by the volume 
of fog concerned between the object 3 and the receiver 2; 

2) with pulsed illumination (of repetition N), the (S/N) ratio Is proportional to 

N \ .-Ro . P 

nT\rv 7* c 

where D Is the maximum distance monitored. 65 
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The convenience of having Illumination pulses (lamp 4) and receMng windows (shutter 10) of equal and 
short duration (10 ns) Is obvious. If a standard television earner (11, 12) is used as the sensor and It is 
proposed to take a 'slice" for every frame (1/25 sec, 1/30 sec) with a maximum S/N ratio, pulses of 10 ns 
would be required 

5 A reasonable number Nq of frames for the reconstruction of a scene would be approximately 50, thus 

covering a maximum monitored distance 

D = Nq . t . c=50 . 10* . 3 . 10* - 160 m Is 1.5 s. 
Information on the distance would thus be associated with each frame, enabling an immediate 

three-dimensional reconstruction of the scene. 
10 However, It Is clearly necessary to Increase the acquisition rate by one order of magnitude to achieve 

detection rates more appropriate for monitoring the road (0.1 s). This can also be achieved byt, combined with 

the above requirement, involves rather complex management of the television camera. 
In order to simplify this management, it Is possible to Integrate the contributions of the Nq light pulses 

necessary to cover with slices the whole space concerned up to the distance D In the television camera, In a 
15 standard time frame (1/25s - 1/30s). 

This can be done by summing Nq light pulses of a duration x with Nq openings of a duration x with increasing 

delays until the maximum distance concerned Is covered for each television frame; in this case, the total 

exposure (E) of the television camera for each television frame will be 

E = Nt(= 5, 10-7 s). 

20 Alternatively, with even simpler management, receiving windows with a duration T may be opened for 
each light pulse emitted. 
Thus, the total exposure (E) of the television camera for each frame is 



E - Nq 2D = Nq 2 1 cNq (5= 5.10 s) 
c c 



30 It Is considered that apart from the contribution of any light sources other than the active one, this second 
hypothesis provides a signal/background ratio which Is worse by a factor less than or equal to 2 than the 
previous one since the time for which the scattering space is illuminated is equal in both cases (Nq. x) and the 
accumulation of signals due to baekscattering by the fog is Nq x in one case and 2Mq* x In the other, whilst the 
contribution of the objects present in the scene remains constant but is summed only once In the first case 

35 and Nq times In the second (the factor is less than or equal to 2 because the additional Integration relates to 
the space between D and 2D). Therefore, In the two cases: 
Case 1 - Background -» E = Nq x 
Signal = 1 
S/N = 1/Nq 

40 Case - Background = Nq . -f - = 2 Nq 2 t 
Signal - Nq t 
S/N « 1/2 Nq. 

In each case, however, It Is possible to cancel out the contribution from the baekscattering in the space In 
the immediate vicinity of the receiver where it is most intense (blind space). 
45 The attenuation of signals due to propagation In the scattering medium (which may possibly be 
compensated for by an Increase in the power emitted by the Dght source 4 so as to retain visibility by virtue of 
the better signal/Interference ratio) will not be considered herein, but that resulting from the putsecHlght 
method will be considered. 
It is clear that the pulsed method provides a signal which is Inferior by a factor 1/N t to that with continuous 
50 light. 

With reference to the typical values Indicated above, the order of magnitude of this reduction is 
approximately 6 . 10*. 

The signal recovery can take place with the use of Intensifying television cameras In which the Intensifler 10 
acts both as such and as a rapid shutter. 
55 Television cameras of this type are currently available commercially. For example, known antiWoomlng CID 
television cameras which are produced by General Electric and Intensify with an optical gain of 5000 are 
capable of pulsed operation with rise times of the order of 5ns. 

In order to minimise the interference generated by the environment, such as daylight or street lighting, it la 
possible to carry out optical filtering at the wavelength of the monochromatic light used for the active emission 
€0 associated with a limited opening time of the television camera (e.g. 5.10"* s of exposure per frame) or even to 
increase the power emitted by the lamp 4. 

As regards interference caused by passing vehicles, if they are provided with the same device 2, 4 operating 
at the same wavelength, frequency of repetition, and duration of acquisition time-windows, thB law of casual 
coincidence between non-synchronised devices applies. The number of coincidences, that is, the direct 
65 Illumination of the sensor unit 2 In one vehicle by the lamp 4 of another vehicle, is 2NT = 2.1.5.103.10«- 
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3.10"* for each vehicle pasqfrd 

This coincidence poses problems only of signal dynamics (which are easily resolved since they relate to 
pulses) whBst the probability of the passing vehicle being detected is Increased and the performance of the 
system is therefore sOghtly Improved. 

5 

Claims 

1 . A method for detecting images of an object (3) in conditions of poor vlsIblBty, characterised In that ft 

com prises the steps of: ^ 

- sending (4) a train of light pulses (5, 6) towards the object (3); 

- observing (2) the object (3) illuminated by the pulses (5,6) in respective timewindows (10); 

- reconstructing (12 to 14) images of the object (3) from the observations In the respective timewindows 
(5, 6) and 

- displaying (15) the images thus reconstructed. 15 

2. A method according to Claim 1, characterised in that the pulses (5, 6) are monochromatic fight 
pulses (4) , preferably with a wavelength X substantially equal to 900 n m. 

3. A method according to Claim 1 or Claim 2, characterised In that the object (3) Is observed In 
substantially monochromatic conditions. 

4. A method according to Claim 2 and Claim 3, characterised in that the object (3) Is observed by mtJafis 20 
of filtering at a wavelength which corresponds substantially to the wavelength of the monoehrcWiatfo tight 
(14)ofthepulees(5,fi). 

5. A method according to arty one of Claims 1 to 4 characterised In that the duration of each observation 
time window is of the same order of magnitude as the duration of each light pulse (5, 6). 

6. A method according to any one of Claims 1 to 4, characterised In fliat each observation time window 25 
has a duration equal to a plurality (Nq) of light pulses (5. 6). 

7. A method according to Claim 1 or Claim 6, characterised in that each observation time window has a 
duration T with 

where c is the speed of Oght in the observation metfium and D Is the maximum permitted distance of the 30 
object 

8. A device for detecting images of an object (3) In conditions of poor visibility, particularly by foe 
method according to Claim 1, characterised In that It comprises: 

- illumination means (14) for sending a train of light pulses (5, 6) towards the object (3) ; 

- televisual means (10 to 12) tor observing the object (3) illuminated by the pulses and for generating 35 
corresponding television signals, the televisual means Including a shutter (10) which Is operable 
selectively (14, 1 6) so as to make the televisual means sensitive only In respective time windows, 

- processor means (13) for reconstructing Images of the object (3) from the television signals obtained, 
end 

- display means (15) for presenting the reconstructed Images. 40 

9. A device according to Claim 8, characterised In that the illumination means (4) generate 
monochromatic light preferably with a wavelength X substantially equal to 900 nm. 

10. A device according to Claim 8 or Claim 9. characterised in that the televisual means (10 to 12) have a 
substantially monochromatic sensitivity due to optical filtering. 

1 1 . A device according to Claim 9 and Claims 1 0. characterised in that the televisual means (10 to 1 2) 45 
have a monochromatic sensitivity which substantially corresponds to the monochromatic light generated 

.bythefflurrtnationmeans(4). 
1Z A device according to any one of Claims 8 to 10, characterised In that the televisual means (10 to 12) 
Include an Image-fntensffler element (1 0). 

13. A device according to Claim 11, characterised In that the Image-intenslfler element (10) can te BO 
activated selectively so that the Intenalfter element (10) also acts as a shutter (10) for defining the 
observation time windows. 

14. A device according to any one of Claims 8 to 13, characterised in that the display means comprise a 
head-up display unit (15). 

15. A motor vehlde (1) provided with a device (2, 4) acoording to any one of Claims 8 to 14, for driving In 55 
conditions of poor visibility. 
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